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Abstract The purpose of this study is to identify 
pre-service primary mathematics teachers’ views regarding 
on Web-based Intelligent Tutoring Systems (WBITS) in 
relation to its usability and influence on teaching. A survey 
method was used. The study was conducted with 43 students 
attending the mathematics teaching program under the 
department of elementary education. The data were collected 
through a paper-based survey composed of three parts. In the 
first part of the survey, there are 9 items about demographic 
information demographic profile of the respondents such as 
name, gender, age, study styles, learning styles, and 
motivation styles. In the second part, there is a scale about 
“Innovation Awareness Scale” and in the third part there is a 
scale about views concerning the usability and the influence 
of WBITS on learning. The data obtained from the study 
were analyzed using SPSS-21 based on descriptive statistics 
such as frequency, percentage distribution, and arithmetic 
mean in addition to MANOVA, which is a parametric test, 
and “Pearson product-moment correlation coefficient”. 
Analysis indicated that the participants were “neither 
negative or positive” regarding both WBITS and innovation. 
It was seen that there was no significant relationship between 
participant awareness regarding innovation and their views 
regarding WBITS. Another important finding is that study 
styles, learning styles, and motivation styles are not 
influential variables over their views about WBITS’ usability 
and its effect on learning attitudes towards WBITS. 

Keywords Pre-service Mathematics Teachers, 
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1. Introduction 

The increased effectiveness of information technology in 
human life has led to changes in learning environments. Due 
to transition from “digital immigrant” generation to “digital 


native” generation, the education given to this new 
generation has led to the emergence of technology-based 
educational and instructional paradigms thanks to innovative 
technologies [1], The common use of the Internet and 
computers in all aspects of life has made it compulsory to the 
Internet and computer in educational activities as well. 

Today, books are replaced by the Internet and web 
technologies which constitute independent teaching 
environments. One of the most important products of these 
technologies is web-based learning environments. 
Web-based learning environments are the synthesis of 
distant learning, Internet/web technologies, and learning 
environments [2,3]. Learning environment is a concept to 
describe teaching processes, and it has a wide spectrum 
ranging from de facto psycho-social learning environments 
to environments created with computer and Internet 
technologies [2,4,5]. 

Literature review highlights that teachers should take into 
account development psychology and learning-teaching 
strategies as well as individual differences while educating 
their students [6], Effective teaching is carried out in learning 
environments where individual differences are taken into 
account. Web-based learning activities can create individual 
learning environments for students with different areas of 
intelligence and learning styles stemming from their 
individual differences for the educational process. 

Intelligent Teaching Systems, which aim active education 
at high quality providing individual atmosphere that gives 
the feeling of the interaction with an expert educator, are 
education systems which adapted to the individuals [53]. 
Web-based systems applies web technology and network 
database technology to analysis and design. While 
developing web based intelligent tutoring systems, 
pedagogic data suitable for students and pedagogic sequence 
of the courses are included [54]. Web-based systems are 
available on central servers and allow a user to learn in her 
own environment and whenever it is appropriate for her [55]. 
Intelligent Teaching Systems is a direction for scientific 
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research to the next generation. 

Web-based learning activities are capable of offering more 
active participation-based, re-constructive, fast, and flexible 
learning environments. Innovative technology applications, 
which provide maximum support and benefit for processes in 
these learning environments where information flow is fast 
and dynamic, are widely on the increase [7,8,9]. In order to 
make use of technology during the learning process, it is 
important to pay attention to how technology is integrated 
into teaching and how it is used in practice. In this sense, it is 
necessary to explore how technology can be improved in a 
way which raises the level of learning and makes students 
acquire basic skills necessary for the 21 st century. 

As European Expert Network on Economics of Education 
(EENEE) analytical report (2015); the reasons why many 
researchers, policy makers and educators believe in the 
potential of Internet-based teaching and learning methods are 
at least threefold: computers have the potential to allow for 
individualized teaching and learning; new technologies 
increase the transparency of student progress and allow 
teachers to more easily monitor and adapt to students; 
computers and the Internet have the potential to engage 
students more than traditional teaching methods do 
productive innovations in the classroom require teachers. 
Compared with the traditional tutoring system, web-based 
learning activities is more innovative. The success of 
Web-based teaching and learning methods depends on the 
ability of the teachers that are able to innovate. In other 
words, teachers play a key role in the effectiveness of a 
Web-based learning activities. Since today’s pre-service 
teachers are tomorrow’s teachers, their innovation awareness 
might affect their students’ skill development. Thus, in this 
study our aim is to investigate the aspects of pre-service 
mathematics teachers’ innovation awareness, who have 
experiences with web-based intelligent tutoring systems 
(WBITS), on their opinions regarding the usability of 
WBITS and their effect on learning. 

1.1. Education and Technology: Overview 

According to literature, technology is a valuable tool that 
can help to improve teaching and learning abilities 
[10,11,12], Studies argue that learning through technology 
has an influence on having more meaningful personal 
interpretations and worldviews [13]. Moreover, it is stated 
that technology allows indirect, formal or informal learning 
as well as a combination of all [9]. To Steiner [14], 
technology, as a system, refers to four components in 
education which are teacher, learner, content and context. 
Six different types of relationships are established between 
these four components and these relationships can be 
reconstructed through technology. However, some studies 
explore the failures of information technologies in education 
[15]. In case of an appropriate use, technology in the 
classroom does not guarantee impact on student outcomes, 
but it can help to improve students’ performance on 
achievement tests [16,17]. 


The role of technology in education has been an important 
question in the literature [18,20-22]. Some of these studies 
focus on technology education [22]. Studies highlight that 
selecting the suitable technology and method for each 
learning need is important for the success of education [9,23]. 
Some studies have suggested various models for technology 
education such as ‘education in technology’, ‘education 
about technology’, and ‘education for technology’ [22]. The 
contribution of these models to science education has been 
explored. 

Technology-centered approaches focus on technology in 
education while learner-centered approaches adapt 
technology to serve learners as a cognitive tool [9]. 
According to Halimatou and Yang[10], the new educational 
technology includes several other technologies including 
cognitive tools that contain semantic organization tools, 
dynamic modeling tools, interpretation tools, tools for 
building the knowledge, and conversation tools. 

To Babette and Reitzes [16], the recent standards 
documents highlight that technology use in education is 
fundamental to help students build 21st century skills. The 
International Society for Technology in Education [24] 
encourages teachers to incorporate across content areas 
including using technology to demonstrate creative thinking 
and to develop innovative products. 

1.2. Purpose and Significance of the Study 

It is stated in the literature that using information and 
communication technologies to have instant access to 
information in different places, and technology as part of life 
play a role in the emergence of new skills which are of 
importance in the information age among students [9,25]. Of 
these skills, two are creativity and innovation. The use of 
information and communication technologies is generally 
suggested as a method to improve such skills [26]. 

Innovation is considered as one of the ten skills which are 
necessary for the 21st century [27]. It involves producing 
new things (or replacing a material of a current product with 
a cheaper material), using new processes, obtaining new raw 
materials (or finding sources for raw and semi-manufactured 
materials), creating new organizational structures, and 
penetrating into new markets (or using better ways of 
marketing a product or service, or introducing new products 
to the market) [28]. Nowadays, it is important to perceive 
changes, adapt to them, and produce policies according to 
the changes and put them into practice [29]. In this sense, 
innovation is a key concept. 

In today’s societies, innovative thinking which is ideas 
and knowledge into new value is gaining importance 
gradually. Therefore, innovation culture should be properly 
planned. The most important responsibility in indoctrinating 
young people into innovative culture is on the shoulders of 
education. Innovative culture is one that supports the 
creation of new ideas and the implementation of those ideas. 
Teachers are the implementers of each educational 
innovation in the class. In this sense, identifying the 
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innovation awareness of pre-service teachers will be 
beneficial since they are the educators of tomorrow. 

Education is one of the most important tools for raising 
awareness and developing good attitudes [30]. Therefore, it 
is important to determine how WBITS can be used for 
education and how they can be adapted into education so as 
to raise awareness concerning innovation. There are only a 
limited number of studies focusing on proved outcomes 
regarding to what extent technology-based models have an 
influence on the development of new skills, which are 
important in the information age, in order to offer interesting 
and strong learning contents, sources, experiences and 
evaluation systems which can measure student development 
in a better way. Furthermore, literature highlights the 
question “Flow should technology use be improved to raise 
learning?” instead of “Flow does technology increase 
learning?” [31]. This study is an attempt to answer such 
questions in the literature. 

The purpose of this study is to explore the influence of the 
demographic characteristics and the innovation awareness of 
pre-service mathematics teachers’, who have experiences 
with web-based intelligent tutoring systems (WBITS), on 
their opinions regarding the usability of WBITS and their 
effect on learning. Questions below were tried to be 
answered in accordance with this general purpose. 

• What are the demographic characteristics of pre-service 
mathematics teachers? 

• What are the levels of innovation awareness of 
pre-service mathematics teachers? 

• What are the views of pre-service mathematics teachers 
regarding WBITS’ usability and its effect on learning? 

• Is there a significant difference between pre-service 
mathematic teachers’ views regarding WBITS by 
innovation awareness, study style, learning style, and 
motivation styles? 

• Is there a significant relationship between pre-service 
mathematics teachers’ views regarding WBITS and 
innovation awareness? 

At this point, it is considered beneficial to make mention 
of intelligent tutoring systems, which were used by the 
participants, and their characteristics. 

1.3. Intelligent Tutoring Systems and the Characteristics 
of the Web-based Intelligent Tutoring System Used 
by the Pre-Service Mathematics Teachers 

Advancements in computer systems and artificial 
intelligence have led to the creation of intelligent tutoring 
environments. In parallel with the developments in artificial 
neural network, intelligent environments have been 
developed. Today, we have Intelligent Tutoring Systems 
(ITS) as well. ITS are computer-based teaching systems 
where teaching content and teaching strategies that 
determine what to teach and how to teach are modelled [32]. 
Graesser [33] states that ITS have student model modules 
which monitor students’ knowledge, skills, strategies, 


motivation, and other learner characteristics in detail. If 
Intelligent Tutoring Systems are used as educational systems, 
they provide feedback and an individual learning 
environment, perceive the level of knowledge, identify the 
deficiencies, and put forward recommendations just like a 
teacher. 

Intelligent Tutoring Systems adapt to the individual needs 
of students and teacher behaviors and aim to achieve teacher 
behaviors. ITS provide students with flexible teaching 
materials, one-to-one learning environment, and feedback 
[34]. Intelligent tutoring systems are currently considered as 
the teaching systems of future [35]. In this regenerating 
world, teachers and pre-service teachers, who have the 
capacity to shape the future, will undertake important roles 
[36]. In this sense, the studies dwelling on teacher views 
regarding WBITS and variables which are influential on 
views regarding WBITS are really important. 

Improvements in communication technologies and the 
Internet have led to the emergence of Web-based Intelligent 
Tutoring Systems (WBITS). ITS, which are Internet-based, 
provide students with an educational process free from time 
and place. ITS provide a flexible learning environment. They 
allow carrying out the activities which cannot be carried out 
in the classes. In other words, they facilitate learning. 
WBITS offer an opportunity for education which is cleansed 
from all the problems likely to be posed by the Internet-based 
education [41]. It is very beneficial that students access 
courses through web and receive feedbacks about their 
performances. WBITS have the potential to save the 
student's mistakes which they make while solving problems 
since it is computer-based. 

1.4. The Characteristics of the Web-based Intelligent 
Tutoring System Used in the Study 

The intelligence characteristics of the web-based 
intelligent tutoring system used by the participants are 
summarized below. Characteristics cover teacher behaviors 
exhibited during educational activities: 

• Looking at another page by skipping the current one is 
prevented. 

• While watching the course content, pages which are 
allowed and not allowed to be watched are determined 
by the system. 

• The system saves the responses given by each student to 
each activity, monitors how many times the student 
opens each page and how long s/he stays there, and 
reports these details to the teacher. The teacher can 
access such details through a screen which is for 
monitoring the students. 

• The teacher can see which pages are covered by the 
student and which are not. 

• The teacher can edit the responses given by the students 
to the activities and write comments to the students 
regarding their responses or the subject. 

• The student’s level of watching the page (studying the 
page), how many times s/he enters the page, and how 
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long s/he stays there are determined by ANN. Students 
who do not meet the expected level of watching the 
page are prevented from viewing the exam page and 
redirected to those pages. 

• The students can take the exam after studying the pages 
specified by the system for an adequate period of time. 
The system estimates the students’ knowledge levels 
after evaluating the exam. If they achieve the level 
specified by the teacher, they can move to the other unit. 
On the exam page, “Question Pass List” shows the 
questions answered or not answered by the students. 
They are showed in different colors. Thus, incomplete 
subjects are identified. 

• At the end of the exam, the learning levels of the 
students are reported to the students through the 
following expressions: Definitely not known, probably 
not known, possibly not known, possibly known, 
probably known, most probably known, and definitely 
known. The system also lists the units, the pages, and 
the subjects in which the students have showed a poor 
performance. Therefore, it guides the students and 
makes recommendations. 

• If students cannot meet the criteria specified by the 
teacher to pass, the units identified by the teacher 
cannot be opened since the system prevents it. 

• If the students want to take the exam without seeing the 
pages advised by the system again, the system 
understands it and prevents the students from doing so 
by directing them to the pages which should be 
reviewed again to eliminate the deficiencies. After 
studying all the pages that should be studied, the 
students are allowed to take the exam if they want to. 

• If the students meet the criteria specified by the teacher 
as learning level, the system guides the students by 
offering the information about the units they can move 
to and activating these units. 

• The students and the teacher can view the answers 
given to the exam questions. The questions answered 
incorrectly by the students are reported to the teacher. 

• The answers given by the students to activity questions 
are monitored; incorrect answers are identified; and 
relevant feedbacks are given to the students. 

• When the students want to see the subjects they have 
studied and succeeded in once again, the system 
provides navigating adaptation. The pages that have 
been seen by the students are saved as seen pages. 

2. Method 

2.1. Research Design 

As the purpose of this study was not to make changes on 

the variables but to reveal the current situation through the 

data collected by the participants via surveys, a survey 

method was employed in the study [37]. Survey models are 


approaches which aim to describe a past or present situation 
as the way it is. Thus, the event, individual or the object 
which is the focal point in the study is tried to be defined 
without any kind of change [38,39]. 

2.2. Participants 

The Criterion Sampling was employed in the study while 
identifying the participants. Criterion Sampling is one of the 
purposeful sampling methods. Criterion Sampling refers to 
forming a sample group consisting of people, events, objects 
or situations with specific characteristics that are previously 
identified depending on the important criteria for the study 
[40]. In this study, engaging in a practice with WBITS was 
taken as a criterion for the pre-service mathematics teachers. 

The students attending the mathematics teaching program 
under the department of elementary education of Kastamonu 
University were included in the sample group. An 
experiment was carried out with them in the Physics-I course 
with a web-based intelligent tutoring system. The 
experiment with the web-based intelligent tutoring system 
covered the subject of labor and energy. 60 people 
participated in the experiment. 60 pre-service mathematics 
teacher participated in the experiment, out of 43 fit into the 
focus of study. All the pre-service mathematics teachers who 
participate in the study had an experience with WBITS when 
the study was conducted. 

2.3. Data Collection Tools 

In the research, the survey instrument consists of third 
parts. The first part deals with demographic characteristics 
(DC) which reveal personal details descriptively. It covers 9 
items. In this respect, the study styles, learning styles, and 
motivation styles of the participants were identified. 

The second part consists of 24 items and four factors with 
the questionnaire developed by inge? et al. [52]. The scale 
aims at the identification of pre-service teachers’ awareness 
regarding innovation. The name of the scale is “Innovation 
Awareness Scale” (IAS). It is a Likert-type scale. 
“Innovation Awareness Scale” has the following choices: “I 
strongly agree” (5), “I agree” (4), “I partially agree” (3), “I 
disagree” (2) and “I strongly disagree”. It has 5-point 
Likert-type rating. IAS consist of four factors, that 
“Management” dimension factor covers 8 items, “Awareness” 
dimension factor covers 9 items, “Areas-of-Implementation” 
dimension factor covers 4 items, and “Defining” dimension 
factor covers 3 items. The general reliability coefficient of 
the scale (Cronbach’s alpha coefficient) was found to be 
0.85. 

The third part covers another Likert-type scale covering 
20 items. This second questionnaire included questions to 
explore participants’ perceptions on usability and the 
influence of WBITS in physics education. The Scale of 
Views Regarding WBITS was designed by the researchers. 
For the answers to be given to the items, a 5-point 
Likert-type rating that is frequently used by the researchers 
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was preferred. Accordingly, the rating is as follows: “I 
strongly agree” (5), “I agree” (4), “1 partially agree” (3), “I 
disagree” (2) and “I strongly disagree” (1). The reliability 
coefficient of this scale is a = 0.781. The value refers to an 
acceptably reliable scale. 

2.3.1. Innovation Awareness Scale 

IAS covers 24 items and four factors. The first factor of 
the scale called “Defining”. It is concerned with the 
definition of innovation. It focuses on the innovation to 
reveal whether or not the defined concept. The second factor 
of the scale called “Areas-of-lmplementation” in which area 
or areas could innovation be used. “Management”, the third 
factor, is concerned with the value and source of innovation. 
The fourth factor of the scale called “Awareness”. It focuses 
on the knowledge of the innovation’s existence. The 
reliability and validity studies completed. The rate of total 
variance explained by this structure of the scale is 65.544%. 
There are 8 items under “management” dimension of the 
scale which is the first one. Items were rotated via Promax 
oblique rotation method. Factor load values range from 
0.751 to 0.925. The eigenvalue of this factor is 7.644, and the 
rate of the variance explained merely by this factor is 
31.851%. The second dimension of the scale involves 
“awareness”. It covers 9 items, and items were rotated via 
Promax oblique rotation method. Factor load values range 
from 0.558 to 0.817. The eigenvalue of this factor is 4.144, 
and the rate of the variance explained by the factor is 
17.267%. The third dimension of the scale is “areas of 
implementation” and it covers 4 items. Items were rotated 
via Promax oblique rotation method. Factor load values 
range from 0.730 to 0.899. The eigenvalue of this factor is 
2.575, and the rate of the variance explained by this factor is 
10.728%. The fourth dimension of the scale is “defining”, 
and it covers 3 items. Items were rotated via Promax oblique 
rotation method and factor load values range from 0.660 to 
0.752. The eigenvalue of this factor is 1.368, and the rate of 
total variance explained by this factor is 5.698%. 

2.3.2. The Scale of Views Regarding WRITS 

The item analysis of the scale of views regarding WBITS 
was made through a pilot study, and expert views were taken 
to ensure validity. In order to ensure validity of the scale, two 
relevant academic members were consulted, and expert 
views were received. Internal consistency coefficient was 
calculated in order to test the reliability of the survey. The 
general opinion survey covers 20 questions. The first 7 
questions cover student views on whether the system 
provides an enjoyable environment, ease of re-watching, 
contribution to out-of-class learning, programmed learning 
environment, ease of access to contents, direction of the 
courses over web, identification of the subjects involving 
deficient knowledge, and directing to these subjects (with 
deficient knowledge). The questions between 8 and 20 in the 
rating scale are about the characteristics of WBITS. 


Questions are about intelligence characteristics, integration 
of personal learning environments to learning activities, 
conditional transitions between units, not having a limitation 
of time and place concerning the content, identification of 
the deficiencies and providing relevant feedbacks, saving the 
responses, links about relevant subjects, and the contribution 
of the system to achievement and learning when used in 
collaboration with in-class education. 

2.4. Data Analysis 

Digital data which were collected through data collection 
tools were coded and transferred to computer by use of 
SPSS-21.0. Analyses were carried out based on 
sub-problems. Descriptive statistics such as frequency, 
percentage, and cross tabulation were used for analysis of 
demographic data. Analysis results are given in tables and 
interpreted. 

Shapiro-Wilk test was used to reveal whether or not the 
scales implemented in the study had a normal distribution. It 
was seen that views regarding WBITS scores and innovation 
awareness scores regarding ITS had a normal distribution at 
0.05 significance level (view>0.05, awareness>0.05). 
Therefore, parametric tests were used to analyze the 
collected data. 

Descriptive statistics, a one-way ANOVA and two-way 
Multivariate Analysis of Variance (MANOVA). were 
applied to reveal the differences, while Pearson’s correlation 
analysis revealed the relationships when answering the 
research questions. Prior to main statistical analyses, all the 
study variables were examined through various SPSS 
programs for accuracy of data entry, missing values and the 
assumptions of multivariate analysis. Box’s M was used to 
test for assumption of homogeneity of variance-covariance. 
Levene’s Test was used in order to check that error variance 
of the dependent variables. Results revealed that dependent 
variables were normally distributed and the non-significant F 
tests from Box’s M statistics were the sign of homogeneity of 
variance and covariance matrices (p > 0.05). 

3. Findings 

The findings obtained from the study are presented in 
accordance with the purposes of the study. Frequency 
distributions, percentages, mean and standard deviation 
scores were calculated using the SPSS-21.0. 

3.1. Descriptive Statistics Regarding Demographic 
Characteristics 

Within the scope of demographic characteristics, gender, 
learning methods, study styles, learning styles, and 
motivation styles were explored. The frequency and 
percentage distributions of the participants are given in Table 
1. 55.8% (n=24) of the participate in the study were female 
whereas 44.5% were male (n=19). 60.5% (26) of the 
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participants had internal motivation while 39.5% (17) had 
external motivation. 51.2% (22) of the participants were 
visual learners; 25.6% (10) were auditory learners; and 23.3% 
(10) were tactile/kinesthetic learners. As for the study style, 
83.7% (36) reported that they preferred to study individually 
whereas 16.3% (7) stated that they preferred to study within 
a group. 


Table 1. Distribution frequency of the participants ’/study group’s 
motivation styles, study styles, and learning styles by gender 





Gender 


Variable 

FEMALE 

MALE 



Number of 
participants 

Column 
N % 

Number of 
participants 

Column 
N % 


Individual 

21 

87.5% 

15 

78.9% 

Study style 

Group 

3 

12.5% 

4 

21.1% 


Visual 

13 

54.2% 

9 

47.4% 

Learning 

style 

Auditory 

7 

29.2% 

4 

21.1% 

Tactile 

4 

16.7% 

6 

31.6% 

Motivation 

External 

11 

45.8% 

6 

31.6% 

styles 

Internal 

13 

54.2% 

13 

68.4% 


3.2. Findings Regarding Innovation Awareness 

The lowest score got from “Innovation Awareness Scale” 
was 53 while the highest one was 93. Total score average 
was found to be 70.33. This result indicates that the 
innovation awareness of the participants as measured by the 
5-point Likert-type scale was 2.93, which refers to the view, 
“I am neither negative or positive”. 

Table 2. Arithmetic mean and standard deviation values regarding 
innovation awareness 

N X SD Level Interpretation 


Neither 


Awareness 

43 

2.9302 

.42528 negative or 

Medium 




positive 


Familiarity 

43 

2.2713 

.30175 Disagree 

Low 




Neither 


Defining 

43 

2.9070 

.70270 negative or 

Medium 




positive 


Areas of 
implementation 

43 

3.3895 

Neither 

.91336 negative or 
positive 

Medium 

Management 

43 

3.4506 

.59957 Agree 

High 


SD: Standard Deviation, X: Mean 

The arithmetic mean and standard deviation values 
concerning the participants’ innovation awareness are given 
in Table 2. The score averages of the participants were 
evaluated within the following categories: “Very Low 
(1.00-1.79)”, “Low (1.80-2.59)”, “Medium (2.60-3.39)”, 
“High (3.40-4.19)”, “Very High (4.20-5.00)”. The awareness 
of the participants regarding innovation was found to be at 
“medium” level. 


The participants had “medium” level scores for defining 
innovation and areas of implementation, which are two 
sub-dimensions of IAS. Another important finding is "high” 
score average for “management”. These findings can be 
indicative of participants’ “neither negative or positive” 
views regarding innovation awareness. 

3.3. Findings Regarding General Opinions About 
WRITS 

The lowest score obtained in regard to WBITS’ usability 
and influence on learning was 64 while the highest was 92. 
Total score average was found to be 79.79. Accordingly, the 
participants’ general opinions about WBITS as measured in 
the 5-point Likert-type scale was 3.9895, which refers to the 
view, “I agree”. The arithmetic mean (X) value of each item 
was calculated in the Scale of Views Regarding WBITS for 
the participants. Agreement levels were identified. They are 
given in Table 3. The mean of the scores in the scale was 
evaluated in the following categories: “Negative (less than or 
equal to 1.59)”, “Neither negative or positive (1.60-3.40)”, 
“Positive (greater than or equal to 3.41)”. The views were 
examined at a=0.05 significance level. 

The students using the web-based intelligent tutoring 
system to learn physic subjects stated that using the 
web-based intelligent tutoring system over the Internet 
during their education process had an influence on their 
learning. As seen in the Table 3, the participants stated with 
high levels of agreement that the web-based intelligent 
tutoring system increased success and positively contributed 
to learning performance though there were some limitations. 

The lowest mean score (3.54±0.80) occurred in the item, 
“if system is used to support formal education and contribute 
to out-of-class learning, it will yield much success”. The 
item in response to which the lowest rate of positive opinions 
emerged (67.4%) was “Conducting courses by making use of 
the intelligence of the system made it easier for you to learn”. 
The item which both had the highest mean of score 
(4.33±0.79) and the highest rate of positive opinion was 
“even if the learning environment was much more effective 
than the real class lectures, it cannot replace face-to-face 
learning that takes place in classes. However, it contributed 
to our in-class learning.” These findings may indicate that 
the participants believe that WBITS facilitate learning thanks 
to WBITS’ intelligence, but they cannot replace face-to-face 
learning. 

The participants reported that implementation through the 
web-based intelligent tutoring system was influential on 
learning thanks to the feedbacks, the conditions for 
transitions from one unit to another, saving the responses, the 
identification of the subjects involving deficient knowledge, 
the rich content, the web-based access to course content, the 
links about the subjects, and the presentation of a planned 
program for the learning environment. 
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Table 3. The Results of the General Opinion Survey Regarding Web-based Intelligent Tutoring Systems (WBITS) 







Neither 


Items 

Mean 

(X) 

SD 

Level 

Negative 

%(f> 

negative or 
positive 

Positive 

%(f) 






%(f) 


1. Teaching physics subjects (labor, energy and conservation of energy) on Internet-based 
intelligent system is enjoyable. 

4.00 

1.3274 High 

9.3(4) 

20.9(9) 

69.8(30) 

2. Re-watching the pages which were previously watched whenever needed facilitates things. 

4.186 

.8798 

High 

- 

20.9(9) 

79.1(34) 

3. If system is used to support formal education and contribute to out-of-class learning, it will 

yield much success. 

3.54 

.7966 

High 

- 

11.6(5) 

88.4(38) 

4. The system’s identification of the seen pages, the pages which can be viewed, and the pages 
which cannot be viewed contributes to learning by offering a planned program. 

3.791 

.8326 

High 

2.3(1) 

23.3(10) 

74.4(32) 

5. Contents are designed in such a way that they can be used easily. 

3.953 

.8326 

High 

- 

27.9(12) 

72.1(31) 

6. The system directs students to pages and subjects in which they have had deficiencies. This 
is a very good feature contributing to learner performance. 

4.186 

.8239 

High 

- 

16.3(7) 

83.7(36) 

7. Following the course on Internet-based intelligent environment enhanced your learning 

performance. 

4.023 

.8306 

High 

- 

18.6(8) 

81.4(35) 

8. Conducting courses by making use of the intelligence of the system made it easier for you to 

leam. 

3.814 

.9065 

High 

- 

32.6(14) 

67.4(29) 

9. Providing personal learning environments increased your participation in learning activities. 

3.698 

.9889 

High 

4.7(2) 

23.3(10) 

74.4(32) 

10. Providing feedbacks during the course (marking the subjects to be reviewed) had a positive 
influence on your learning. 

3,884 

,9053 

High 

- 

23,3(10) 

76,7(33) 

11. Conditional transitions from one unit to another (end of subject transition questions) 
increased our success. 

4.000 

1.0235 High 

4.7(2) 

14.0(6) 

81.4(35) 

12. The questions and activities about the subject provided in the system were richer than those 
provided in books and this facilitated our learning. 

4.047 

.8985 

High 

2.3(1) 

18.6(8) 

79.1(34) 

13. Since there was no limit on time and place, more examples and activities were presented 
than in the class, which made positive contributions to our learning. 

3.884 

.9312 

High 

- 

25.6(11) 

74.4(32) 

14. According to the answers given to the transition questions, the subjects involving deficient 







knowledge were determined by the system, and the system gave feedbacks to study those 

4.047 

.7222 

High 

- 

18.6(8) 

81.4(35) 

subjects once again. This made a positive contribution to our learning. 







15. Saving the responses and reminding the last page one studied when one logged in 
facilitated our learning. 

4.186 

.7945 

High 

- 

23.3(10) 

76.7(33) 

16. The animations, links, and figures explaining the relevant subjects in the web-based 
intelligent tutoring system enriched our learning environment. 

3.953 

1.0455 High 

4.7 (2) 

18.6(8) 

76.7(33) 

17. The feedbacks regarding the answers given to the activities made positive contributions to 

our learning. 

4.023 

1.3361 High 

7.0 (3) 

20.9(9) 

72.1(31) 

18. Accessing the teacher whenever needed and the feedbacks given by the teacher made 
positive contributions to our learning. 

3.814 

.9821 

High 

4.7 (2) 

20.9(9) 

74.4(32 

19. When conditions for transitions were fulfilled, the next unit was enabled and activated for 
us to leam the relevant subjects, which had a positive reflection on our learning. 

3.698 

1.1027 High 

7.0 (3) 

23.3(10) 

69.8(30) 

20. Even if the learning environment was much more effective than the real class lectures, it 
cannot replace face-to-face learning that takes place in classes. However, it contributed to our 

4.326 

.7783 

Very 

High 


9.3 (4) 

90.7(39) 

in-class learning. 







SD: Standard Deviation 


3.4. The Difference between the Pre-service Mathematics Teachers’ Views Regarding WBITS and Innovation 
Awareness by Demographic Characteristics 

Two-way multivariate analysis (MANOVA) was conducted to reveal the differences between the views regarding WBITS 
and innovation awareness based on pre-service teachers’ motivation styles, study styles, and learning styles. Before 
conducting the two-way multivariate analysis, the assumption of homogeneity of variance was tested. According to Levene’s 
test results, variances were homogeneous regarding innovation awareness (p=0.13, p>0.05) and views regarding WBITS. 
(p=.l 1, p>.05) (Table 4). 


Table 4. Levene’s Test Results 



F 

dfl 

df2 

P 

View 

1.707 

9 

33 

.127 

Awareness 

.679 

9 

33 

.722 


df: Degree of freedom, p: significance value. 
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At the end of two-way MANOVA, it was seen that the independent variable of motivation styles did not have a significant 
influence on innovation awareness (F=3.1, p=0.088,r|2=0.0860) and views regarding WBITS (F=0.122, p=0.729,r|2=0.004) 
[Wilks’ Lambda k=0.914, F(2.32)=1.512, p >0.05, r|2 =0.086]. In other words, it was accepted that the population averages of 
the obtained scores did not differ by motivation. r\2 (eta square) expresses to what extent the multiple variance in the 
dependent variables is explained by the independent variable[42]. Thus, it was deduced that motivation styles does not have 
an explanatory effect on the dependent variables since q2=0.0860. Two-way MANOVA results regarding the data are given 
in Table 5. 


Table 5. Two-way MANOVA results 


Source 

Dependent Variables 

SS 

df 

MS 

F 

P 

fi 2 


View 

523.713 

9 

58.190 

1.740 

.119 

.322 

Corrected 

Awareness 

925.366 

9 

102.818 

.983 

.472 

.211 


View 

91003.260 

1 

91003.260 

2721,677 

.000 

.988 

Fixed 








Awareness 

63059.988 

1 

63059.988 

603.169 

.000 

.948 

Motivation styles 

View 

4.094 

1 

4.094 

.122 

.729 

.004 

Awareness 

324.121 

1 

324.121 

3.100 

.088 

.086 

Learning style 

View 

139.299 

2 

69.650 

2.083 

.141 

.112 

Awareness 

412.323 

2 

206.162 

1.972 

.155 

.107 

Study style 

View 

72.627 

1 

72.627 

2.172 

.150 

.062 

Awareness 

273.209 

1 

273.209 

2.613 

.115 

.073 

Motivation styles * 

View 

137.006 

2 

68.503 

2.049 

.145 

.110 

Learning style 

Awareness 

252.717 

2 

126.358 

1.209 

.311 

.068 

Motivation styles * 

View 

24.008 

1 

24.008 

.718 

.403 

.021 

Study style 

Awareness 

283.500 

1 

283.500 

2.712 

.109 

.076 

Learning style * Study 

View 

111.271 

2 

55.636 

1.664 

.205 

.092 

style 

Awareness 

602.383 

2 

301.191 

2.881 

.070 

.149 


View 

1103.403 

33 

33.436 




Error 

Awareness 

3450.075 

33 

104.548 





View 

275389.000 

43 





Total 

Awareness 

217040.000 

43 






View 

1627.116 

42 





Corrected Model 

Awareness 

4375.442 

42 






SS: Sum of square, df: Degree of freedom, MS: Mean of square, F: MANOVA result, p: significance value, q ’: Partial eta squared. 


According to the Table 5, there was no significant 
difference between the study styles [Wilks’ Lambda k=,886, 
F(2.32)=2.067, p >0.05, q2 =0.0114], learning styles [Wilks’ 
Lambda k=0.781, F(4.64)=2.104, p>0.05, q2=0.116], study 
styles * learning styles [Wilks’ Lambda k=0.762, 
F(4.64)=2.328, p>.05, q2=0.127], motivation styles * 
learning styles [Wilks’ Lambda k=0.818, F(4.64)=1.688, 
p>0.05, r)2=0.095], and motivation styles * study styles 
[Wilks’ Lambda k=0.913, F(2.32)=1.519, p>0.05, q2=0.087] 
of the participants as well as their innovation awareness 
levels and views regarding WBITS. In other words, it was 
accepted that the population averages of the obtained scores 
did not differ based on study styles or learning styles. 
Therefore, it was concluded that neither study styles nor 
learning styles have an explanatory influence on the 
dependent variables. 


3.5. The Relationship Between the Views Regarding 
WBITS and Innovation Awareness 

In order to reveal whether there was a relationship 
between the participants’ views regarding WBITS and 
innovation awareness, Pearson correlation analysis was 
conducted. The analysis results are given in Table 6. 
Pearson’s correlation coefficient was found to be r=0.046. 
This results indicates no relationship or low relationship 
which should not be taken into account. The p value to be 
used in the significance test for the obtained coefficient was 
found to be 0.767. This p value indicates that the correlation 
coefficient is not significant. These results may imply that 
there is no significant relationship between innovation 
awareness and views regarding WBITS. 
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Table 6. The analysis of the correlation between the scores of the 
participants’ views regarding WBITS and innovation awareness 




Awareness 

View 


Pearson Correlation 

i 

.046 

Awareness 

Sig. (2-tailed) 


.767 


N 

43 

43 


Pearson Correlation 

.046 

1 

View 

Sig. (2-tailed) 

.767 



N 

43 

43 


When each item in the general opinions survey regarding 
WBITS was analyzed by taking into account the 
classification of negative, neither negative or positive, and 
positive views, a differentiation was detected only in the 
seventeenth item. One-Way ANOVA was carried out to 
identify differences based on the views. The relevant results 
are given Table 7. 


Table 7. The influence of innovation awareness on view 


Source of 
Variance 

Sum of 
Square 

SD 

Mean of 
Square 

F 

P 

Significant 

Difference 

Inter-groups 

542.679 

2 

271.340 

10.008** 

.000 

*1-2; *1-3 

Intra-groups 

1084.437 

40 

27.111 




Total 

1627.116 

42 






SD: Standard Deviation, F: ANOVA result, p: significance value. 

* p< 0.05=statiscially significant, 1= Negative, 2 = Neither negative or 
positive, 3 = Positive. 

**The extent of influence was found to be 0.58. 

There was a significant difference between the general 
opinions about WBITS of the mathematics teachers towards 
the item, “The feedbacks regarding the answers given to the 
activities made positive contributions to our learning.” by 
innovation awareness (F (2.40) =10.008, p=0.00). 

4. Discussion 

4.1. Results Based on the Demographic Characteristics 
of the Pre-Service Mathematics Teachers 

The study results indicate that the pre-service mathematics 
teachers’ views regarding WBITS did not differ by 
motivation styles. 60.5% of the participants had internal 
motivation while 39.5% had external motivation. External 
motivation consists of two dimensions which are social 
motivation tools and organizational tools. Social motivation 
involves the quality of relationships such as friendship and 
cooperativeness whereas organizational dimension involves 
opportunities offered by the organization to increase the 
work performance [44]. Since the web-based intelligent 
tutoring system used by the participants provided interactive 
links, a socially weak learning environment emerged. The 
use of computers to instruct, the students had lower levels of 
inter-personal relationships compared to the real class 
environment. This is believed to reduce the external 


motivation. Moreover, one of the basic characteristics of 
WBITS is programmed learning. The purpose is to achieve 
long-term objectives gradually by completing the short-term 
objectives. One of the factors of internal motivation is 
individual objectives. In this sense, it may be thought that 
WBITS raise internal motivation levels thanks to the 
individual education and programmed learning environment 
they provide and thus may positively contribute to learning 
process, and as a result the motivation styles of the students 
have an influence on their views regarding WBITS. 
However, it was seen at the end of the study that motivation 
style did not have an explanatory influence on the views 
regarding WBITS. This is a highly remarkable result. 

According to the study results, learning style is not a 
variable having an explanatory influence on the views 
regarding WBITS. Nearly half of the participants (54.2%) 
were identified as visual learners. The interface of WBITS 
for interaction is computer screen. Since the individuals 
interact with visual materials and influence during their 
learning processes, it is possible to think that it may 
influence their visual learning, which is one of the 
demographic characteristics. The literature reports that 
visual technological products influence both the lives and the 
mental processes of children and young people and change 
their nature [44,45-47]. WBITS contribute to both using 
visuals in-depth and accessing course contents over the 
Internet. Thus, they provide a suitable environment for 
pre-service teachers who prefer visual learning style. This 
being the case, the variable of learning style is expected to be 
influential on views regarding WBITS. However, this 
expectation is not supported by the study results. 

When the participants’ views regarding WBITS were 
explored based on their study styles, no significant 
difference was observed. About four-fifth of the participants 
(83.7%) were seen to have individual study style. Study style 
refers to the relationship between the influence and the 
learner. This creates differences between individual 
perceptions. Individual differences are classified in three 
categories which are cognitive, affective, and physiological 
[48]. These dimensions constitute the study styles of the 
participants. An individual learning environment is offered 
in transferring the course content of WBITS which are 
systems that try to act like teacher, adaptable to student's 
individual needs and teacher's behavior to participants. Each 
participant follows the course content based on his/her 
individual differences for the educational process. They have 
no problem in timing since there is no limitation. According 
to the literature, WBITS offer individual interactive learning 
environments which increase student achievements [49]. 
Thus, it can be said that it is quite an unexpected finding that 
the variable of study style has no explanatory influence on 
the views regarding WBITS. 

4.2. Results Based on Innovation Awareness 

Today, students are expected to possess the 21st century’s 
learner skills [19,50], “Creativity and innovation” are among 
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the ten skills stated in the literature as a must for the 21st 
century [27,51]. Therefore, pre-service teachers, who are to 
play an important role in the education of individuals, are 
expected to possess such skills. Based on this expectation, 
this study was carried out to identify innovation awareness 
levels. In the present study, the innovation awareness of the 
participants was measured to be 2.93 in the 5-point 
Likert-type scale, which refers to a “neither negative or 
positive” view. Moreover, it was seen that the participants 
did not know about the implementation of the innovation, 
had difficulty in defining the concept of innovation, were 
neither negative or positive about the importance of 
innovative approaches within the education system, and had 
no clear view regarding R&D works as a source feeding 
innovation. Furthermore, they stated that there were no 
influences to make them aware of innovation. This indicates 
that the participants did not have awareness, which is 
considered as the first step of the aforementioned skill. This 
result is different from some results reported in the literature. 
Oriin et al.[50] conducted a study with 422 pre-service 
teachers from 12 different departments and four different 
grades. At the end of that study, the innovativeness profiles 
of the participants were revealed. That study indicated 
considerable rates of “being a pioneer” (f= 140; %33.2) and 
“being innovative” (f=31; %7.3). This shows that majority of 
pre-service teachers possess the "innovative” skill. 

Another result regarding innovation awareness is that the 
participants "highly” acknowledged the importance of 
innovation for economy, sustainable development, meeting 
the rising level of employment, transforming knowledge into 
a social benefit, and raising the society’s quality of life. 

4.3. The Relationship Between Innovation Awareness 
and General Opinions Regarding WBITS 

The views and the opposing views of the pre-service 
mathematics teachers using WBITS to learn physics subjects 
in relation to WBITS’ usability and influence on learning 
were explored in the present study. The views of the 
participants regarding WBITS as measured in the 5-point 
Likert-type scale was found to be 3.9895, which refers to 
“positive” opinions. According to the survey results, the 
participants generally stated that WBITS increase academic 
achievement, provide permanent learning by supporting 
individuality, provide an entertaining and effective learning 
process thanks to rich visual presentation, but cannot replace 
face-to-face learning in the real class environment even if it 
is much more effective than in-class lectures. Moreover, 
according to the participants, WBITS are also effective 
during the study process thanks to the feedbacks, the 
conditions for transitions from one unit to the other, saving 
the answers, the identification of the subjects involving 
deficient knowledge, the rich content, access to web-based 
course content, the links about the subjects, and the 
programmed learning environment they provide. 

Another important result is that no significant relationship 


was found between innovation awareness and views 
regarding WBITS. This may be because the awareness levels 
of the participants were not as expected. Moreover, the 
participants opined that innovation could be in economic and 
commercial fields (See Table 5 and Table 6). The 
participants stated, as seen in the Table 1, that they came 
across innovation in their educational lives only at a “poor” 
level and it remained as a concept which they heard in 
technology stores but could not define. Since they did not 
know innovation but just had a limited amount of 
second-hand information about it, no significant relationship 
could be detected between WBITS and innovation 
awareness. 

4.4. Recommendations 

Contents, sources, experiences, and technology-based 
models for creating evaluation systems which can measure 
student improvement better may be developed in such a way 
that they encourage students to have innovative approaches. 
These innovative elements may be integrated into lectures or 
evaluation processes. Elements such as problems which can 
lead students to produce new ideas, the ways of making the 
current situation more convenient, the needs which have 
never been taken into account before, or answering the same 
question from different perspectives may be added. The 
WBITS developed within this context may be tested to see 
whether or not they are influential on the innovative 
approaches of students or not. 

The present study is limited to WBITS and the labor, 
energy and conservation of energy subjects of physics course. 
The learning styles and the study styles of the pre-service 
teachers are prone to the use of technology. [P4]However, 
there was no difference between the participants’ views 
regarding WBITS. Conducting studies for different subjects 
may be beneficial to reveal whether study styles, learning 
styles, motivation styles, and innovation levels are 
influential on WBITS. 

This study was conducted with pre-service mathematics 
teachers. Repeating the study with pre-service teachers from 
different branches and revealing the influence of the 
implementation on students from different departments may 
be beneficial. 
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